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ABSTRACT.  Let  c 


generalized  numerical  range  of  an  n X n matrix  A 


associated  with  c 


,x  ) varies  over  orthonormal  systems 


are  given.  Next,  we  study  integrals  of  the  form 
(A)dp.(c)  where  P-(c)  is  a measure  defined  on  a 

The  above  characterizations  are  used  fT\ 


domain  in  ]R 


to  study  the  inclusion  relation 


for  which  this  inclusion  holds 


more  elementary  ones,  when  the  integral  reduces  to  a 


finite  linear  combination  of  ranges . In  particular,  we 


obtain  the  inclusion  relations  of  the  form  W (A)  c AW  ,(A) 


which  hold  for  all  A 


~ — *■*>  s « vi  r.m, 
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where  is  a class  of  Hermitian  matrices  depending  on  c . 

In  Section  3 we  define  integrals  of  the  form  / W (A)d|i.(c)  where 

w c 

is  a domain  in  Kn  and  M-(c)  is  a nonnegative  measure  on  0.  Since 


the  sets  W are  convex,  such  integrals  are  convex  as  well,  and  we  may 


define  them  in  terms  of  their  support  functions. 


n 

a " i £ r:  ■*  !S  'ft! 

A* 

«» 

V. 

m 

1 

r5 
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Finally,  using  the  above  characterization  of  we  investigate 

inclusion  relations  of  the  form 

(1.2)  / W (A)dJJ-(c)  c AW  ,(A)  , A = constant  , 

C C 

which  hold,  uniformly,  for  all  A e i.e.,  for  all  n-square 

matrices.  If  the  measure  M-(c)  is  concentrated  on  a finite  number  of 
vectors  c,  then  (1.2)  is  reduced  to  inclusion  relations  involving  finite 
linear  combinations  of  generalized  numerical  ranges . Such  relations  were 
considered  in  earlier  works  [2,  3] . 

In  particular,  for  given  vectors  c,  c'  we  obtain  necessary  and 
sufficient  conditions  under  which 

Wc(A)  c , VA  6 Cnxn  ■ 

. For  any  vector 

c = (r^, ••*,7n)  consider  the  diagonal  matrix 

C=  diag(c)  = diagC^,  • • -,7n)  , 

and  construct  the  class  of  matrices 

* 

Uc  = convfUCU  : U unitary]  , 

where  conv  denotes  the  convex  hull. 

Since  we  restrict  attention  to  c € ]Rn  it  is  evident  that  the 

elements  of  1*  are  Hermitian. 
c 

Using  we  have  the  following  characterization  of  ranges  with 


real  coefficients . 
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THEOREM  1.  If  c £ ln  then 


WC(A)  = (tr(HA)  : H e U(j} 


Proof.  It  follows  from  the  definition  of  W (A)  in  (l.l)  that 


Ihus 

(2.1) 

which  implies  that 


Wc(A)  = {tr(cU  AU)  : U unitary] 


WC(A)  = (tr((UCU  )A)  : U unitary]  , 


W (A)  c {tr(HA)  : H e u 1 • 
c c 


For  the  converse  inclusion  let 


H = E \(UtCU  ) ; \ £ 0 , T,  A = 1 , 

i i 

be  an  arbitrary  element  of  ^ . By  the  convexity  of  and  by  (2.1) 

we  have 


So, 


tr(HA)  = T,  \ trCCUjCUj^A)  e W (A) 


(tr(HA)  : H e nc)  c Wc(A)  , 


and  the  theorem  follows . 


We  introduce  two  definitions  which  lead  to  another  characterization 


of  W (A). 


DEFINITION  1.  (i)  A real  vector  c = (?„  >’’’,7  ) is  called  ordered 

1 n ' 


if 


’ 


-1+- 

(ii)  We  say  that  c,  c'  satisfy  c ' -<  c if  there  exists  a doubly 
stochastic  matrix  S (i.e.,  a matrix  with  nonnegative  entries  wnose 
row  sums  and  columns  sums  equal  1),  such  that  c'  = Sc. 

In  Theorem  7 of  [3]  we  proved  the  following. 


LEMMA  1 . For  ordered  c , c ' we  have  c ' < c if  and  only  if 

£ £ 

T,  y\  < £ 7.  , l = 1,  • • -,n  , 
j=l  3 j=l  3 

with  equality  for  t = n. 

DEFINITION  2.  Let  c e TR11,  and  let  (l  < £ < n)  be  the  set  of 

all  orthonormal  ^-tuples  of  vectors  in  Cn.  We  define  y to  be  the 

c 

class  of  all  Hermitian  matrices  H for  which 
£ £ 

(2.2)  Tj  (Hx.,x  ) < £ 7.  , W (xn , . • .,xp)  € A.  , £ = 1,  • • • ,n  , 

j=l  3 j j=l  5 1 1 * 


. 

! 


t 


with  equality  for  £ = n. 

Let  e^,-*-,e^  "the  standard  basis  of  C11-  Note  that  if  £ 7 = 0 

(which  is  the  case  assumed  in  Section  3),  then  the  equality  for  £ = n in 
2.2  implies  that 

n 

z (H e^e^)  «=  £ ^ « 0 ; 

i.e.,  all  members  of  y have  trace  0 . 

c 

LEMMA  2.  If  c is  ordered  then  y = U • 

— - ■ ■ - 1 ■ - c c 


Proof.  Take  a unitary  matrix  and  orthonormal  vectors  x^, •••,x^, 

(l  < £ < n) . Since  the  vectors  y^  = U x^,  j = 1,  •••,£,  are  orthonormal 
as  well,  it  is  not  hard  to  verify  that 


A/  ^ A/ 

(2.3)  £ (UCU*x.,x .)  = £ (Cy  ,y.)  < 7,  + •••  + 7t  , c = diag(c)  , 

.1=1  3 3 j=l  J 3 


j=l  0 u i- 

with  equality  for  £ = n.  Therefore,  if 
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1 


H = T VjCUi  ' ^ > 0 > ^ \ = 1 J > 

is  any  (Hermitian)  matrix  in  Uc>  we  find  by  (2.3)  that 


V ( Hx j , x j ) = £ T,  ^(UjCU-X^)  < T,  \ T 


3=1 


3=1  i 


_ V 


i 3=1 


3=1 


'j  ' 


with  equality  for  i - n.  So,  by  Definition  2,  He  y^,  and  consequently 

U„  c W . 
c c 

Conversely,  take  any  H e . Since  H is  Hermitian,  it  is  uni- 
tarily  similar  to  a real  diagonal  matrix,  i.e.,  there  exists  a unitary 
V such  that 


(2.4) 


C ' = V HV  = diag(^,-..,^)  , 


where  we  may  assume  that  c'  = (7^,  • • • ,7^)  is  ordered.  Using 

(2.2)  and  the  orthon>rmal  vectors  x.  = Ve.,  j = 1,  •••,<!,  we  find 

J J 

that 

i i a i a 

r,  7\  = T.  (C'e  ,e  ) = £ (V*HVe ,,e.)  = £ (Hx  ,x.)  < £ 7.  , 

3=1  J 3=1  33  3=1  3 3 j=l  3 3 3=1  3 

with  equality  for  l>  = n.  That  is,  by  Lemma  1,  c'  < c.  Hence,  there 
exists  a doubly  stochastic  matrix  S such  that  c'  = Sc . Now  recall  that 
doubly  stochastic  matrices  are  convex  combinations  of  permutation  matrices 
P^.  In  particular  S = T^.  P . Thus 


(2.5) 


c-  = r Vo®  * > "A-1 

creS 

n 


where  is  the  symmetric  group.  Since  for  every  B,  P^BP^  has  both 

the  rows  and  columns  of  B permuted  according  to  cx,  we  have 


I t 


(2.6) 


diag(Pac)  = P^  diag(c)P*  = P^CP*  . 
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* 

‘O 


So,  by  (2.5),  (2.6), 

(2.7)  C'  = diag(c’)  = £ \ diag(P  c)  = £ A P CP’ 

cr  a 

From  (2.4)  and  (2.7)  we  obtain 

(2.8)  h = vc' v*  = £ \1(vpJ  c (vp  )*]  = £ \(uacu*)  , \ > 0 , E \ = 1 , 

cr  cr 

where  U s VP_  are,  of  course,  unitary.  Hence,  H e u , i.e.,  W c U 

and  the  proof  is  complete. 

Theorem  1 together  with  Lemma  2 imply  a second  characterization  of 
generalized  numerical  ranges  with  real  coefficients . 

THEOREM  2.  If  c is  ordered  then 


W (A)  = (tr(HA)  : H e » } . 


Another  simple  consequence  of  the  last  lemma  and  the  convexity  of 

U is  that  for  ordered  c,  M is  convex, 
c c 

At  this  point  we  recall  the  definition  of  the  k-numerical  range, 

(l  < k < n),  given  by  Halmos  [4,  §167],  which  after  a convenient  normaliza- 
tion becomes 

W (A)  = tr(PAP)  : P = orthogonal  projection  of  rank  k]  . 


It  can  be  verified  that  W^(A)  may  tie  written  as 

^ (Axa,x3)  : (V-’V  € . 


That  is,  the  k-numerical  range  is  a special  case  of  the  generalized 
numerical  range. 


The  matrices  K are  those  Hermitian  matrices  which  satisfy 


Definition  2 with  c = c^.  Using  this  definition  one  can  show  that 


H = {Hermitian  H : 0 < H < i I , tr(H)  = 1}  . 


Thus  Theorem  2 generalizes  the  result 


W (A)  = [tr(HA)  : 0<H<h  , tr(H)  = 1]  , k = 1, • • • ,n  , 


of  Fillmore  and  Williams  [4,  Theorem  1.2]. 


3.  Integrals  of  generalized  ranges.  In  this  section  we  are  interested 
in  linear  combinations,  or  more  generally,  in  integrals  of  the  sets  Wc(A), 
where  A is  arbitrary  but  fixed,  and  c varies  in  seme  domain  of  Tlf1  . 

Let  c = (7^, — ,7n)  be  a real  vector  with  y = J)  7 ^ / 0,  and 
consider  the  vector  b = •••,£5^)  defined  by 


B s diag(b)  = diag(c) 


So,  by  Theorem  1 


W (A)  = {tr(UBU  A)  : U unitary] 


{tr[u(C  - 2-  I)U  A]  : U unitary]  = We(A)  - {^-tr(A)] 
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This  argument  suggests  that  it  is  convenient  to  restrict  attention 

to  those  vectors  c for  which  E 7 . = 0.  The  limitation  merely 

J 

involves  a translation  of  the  ranges  by  multiples  of  the  trace,  or, 

equivalently,  the  restriction  to  matrices  of  trace  0. 

Since  W is  invariant  under  permutations  of  the  y.,  we  may 
c j 

assume  that  each  vector  c in  our  domain  is  ordered.  Hence,  we  con- 
sider t.hp  set  of  ordered  vectors  c with  E 7 ^ = 0,  which  form  a 
conical  subset  n of  an  (n-1) -dimensional  subspace  of  ]Rn  . 

We  are  ready  now  to  study  integrals  of  WC(A)  relative  to  an 
arbitrary  measure  M-  on  n.,  that  is  integrals  of  the  form 


(3-1) 


VA)  =JC  Wc(A)du(c). 


One  way  of  defining  the  integral  in  (3-1)  is  by  carrying  linear  sums, 

over  partitions  of  (l,  to  the  limit.  Alternatively,  one  realizes 

that  J , being  an  integral  of  the  convex  sets  W , is  a convex  set 
M'  c 

as  well.  Hence  J may  be  characterized  by  its  support  function 
(e.g.  [2]  part  V), 


u(j  ,9)  = sup  Re(ze  1 ) , 0 < 0 < rr 

* 2£J4 

In  order  to  evaluate  u(j  ,9),  we  consider  the  support  functions  of 
our  closed  convex  integrands  . We  have 

u(W  ,0)  = u(c ,0 ) = max  Re(ze  lS)  , 0 < 0 < n 

c z €W 

c 

Since  u(c,0)  is  a linear  function  of  c in  the  sense  that 


u(AW^  + A'Wc,,0)  = Au(c,0)  + A’u(c’,0)  , wA,A'  > 0 , 


we  have 


NAii&fi 


■<»&**** 
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viCJ^^S)  = u (^J  W c^(c)  ,oj  = J'  u(Wc,0)dM-(c)  = u(c,e)dp.(c) 

Of  course,  the  measure  |x  may  fee  concentrated  at  a finite  number 

of  points  c,  ,,--,c  eC.  In  this  case  the  integral  J,  reduces  to 
x m p. 

the  finite  linear  combination 

H(C;L)WC  (A)  + •••  + (x(cm)Wc  (A)  . 

1 m 

Since  W^c  = AWc  for  scalar  A,  we  shall  avoid  integration  over 
proportional  vectors  of  0.  This  can  fee  achieved  fey  restricting  integra- 
tion to  the  domain 


*>  = [c  : c = {y±,  • • ->7n)>  T,  = °>  7±  = 1}  , 

which  is  the  bounded  set  of  all  vectors  in  C with  y.  = 1. 

The  above  concept  of  integration  can  be  extended  in  order  to  con- 
sider the  integral 


(3-2) 


d|x(c)  . 


We  recall  that  the  integrands  yc  are  convex  sets  in  the 

2 

(n  +n  -2  real  dimensional)  space  H of  Hermitian  matrices  of  trace 

0.  It  follows  that  y is  also  a convex  set  in  H.  Again,  the  con- 

\1  •+*  ° 

vexity  of  and  y implies  that  the  integral  may  fee  defined  in 

terms  of  the  support  functions  of  M . Here,  in  analogy  to  the  previous 

c 

case,  the  support  function  of  y assigns  to  each  point  H.  on  the 

c X 

unit  sphere  of  H,  the  distance  from  the  origin  0 of  H to  the  plane 
of  support  of  yc  perpendicular  to  the  direction  01?^. 

Having  the  integrals  J and  y defined  we  state  our  main 

H*  M* 

result . 





. . 


Bl 
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THEOREM  3.  Let  ix  be  a nonnegative  measure  on  jQ,  and  let 
c ’ 0 be  an  ordered  vector  with  E y\  = 0 . Then 

(3.3)  f Wc(A)d|x(c)  c AWc,(A),  VA  e , 

if  and  only  if  A > n(c'  ) or  A < £(c' ) where 

P 7-,  + • * * + 7£ 

(3.4a)  t(c')  = max  / — djx(c)  , 

1 < £ < n ^ 71  + ' ’ ' + 7l 

r + •••  + 7 2 

(3.4b)  i(c')  = min  / — ; dM-(c)  . 

l<^<n  7n+  + 7n-Ul 

Proof.  In  the  proof  of  Lemma  7 of  [3]  we  have  shown  that  if  c'  ^ 0 
with  E 7j  =0,  then 

(3-5)  + •••  + 7]  > 0,  y'n  + ...  + y'n_2+1  < 0;  £ = 1,  •••,n-l  . 


This  establishes  that  T),  £ of  (3.4)  are  well  defined  and  since  M-  is 
a nonnegative  measure  we  see  that  tj  > 0,  C < 0 . 

Next  we  show  that  A > t](c')  or  A < C(c’)  imply  (3.3).  For  this 
purpose  we  use  the  definition  of  y , Theorem  2,  and  the  linearity  of  the 
trace  to  evaluate  the  set  on  the  left  of  (3.3): 


(3-6) 


Wc(A)d|x(c)  = 


: H e yc)d|x(c) 


(tr (HA)  : H e y^}  . 


Now  choose  A with  A > rj(c').  Since  A > 0,  the  vector  Ac' 
remains  ordered.  Hence,  by  Theorem  2, 


(3-7) 


AW  (A)  = W (A)  = {tr(HA)  : H e « . 

c ' Ac  Ac 
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From  (3-6),  (3*7)  we  see  that  in  order  to  prove  (3.3)  it  suffices  to 


show  that 


(3-8) 


y c y 

V V ' 


Thus,  let  Hg  he  a matrix  in  y . Then  by  (3.2),  there  exist  elements 


Hc  e y^  for  all  c e such  that 


H = / H Me)  . 

The  matrices  Hc  satisfy  Definition  2,  and  since  |i.  is  a nonnegative 
measure  on  #),  it  follows  that  for  Z -tuples  xn,---,x^  in  we  have 

Z p Z p 

(3-9)  T,  (H„x  ,x.)  = / £ (H  x ,x,)d|l(c)  < / (7  + . • • + 7*)d|J.(c);  Z = 1,  . 

j=l  J J df>  j=l  3 J JX) 


with  equality  for  Z - n.  Since  T,  7 . = £ 7l  - °>  the  above  equality  for 

J J 

& = n implies 


(3.10a) 


£ (H0x  ,x  ) = 0 = A £ 7; 
0=1  J J 0=1  J 


For  1 < Z < n we  use  the  assumption  A > rj  to  obtain  from  (3.9)  that 


y . j^y 

(3.10b)  T,  (H  x ,x  ) < (7’+  ••■  + y\)  I 7 Me)  < A(7’  + . . . +7p 

0=1  ° d J 1 ^ 7i+---+7£  1 * 

By  Definition  2,  the  relations  (3. 10)  mean  that  HQ  e y^ , . Hence,  (3.8) 
holds,  and  consequently  the  inclusion  in  (3.3)  follows. 

For  A < £ the  situation  is  slightly  different.  Consider  the 
vector  c"  = (-7^, • • • , -7^) . Since  c’  is  ordered,  c"  is  too.  Also, 
the  condition  A<  £(c')  becomes 


p y+...+7  p y+...+y 

(3.11)  -A  > -£(c’)  = -min  / -7- Me)  = max  / -7 -7 

l<i<n  V 'n-Ul  l<Z<nJn  7 7n-Z+l 


= T)(c")  . 
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Hence,  by  the  previous  part  of  the  proof,  we  have  that 


(3-12) 


J Wc(A)d^(c)  c -Aw  „(A)  , VA  £ 


But  -Ac"  is  merely  a reordering  of  Ac'.  Thus,  the  set  on  the  right 
of  (3-12)  satisfies 


I J 


-AW  (A)  = W „( A)  = W (A)  = AW  (A)  , 

c -Ac  Ac'  c' 

and  we  obtain  (3.3). 

To  complete  the  proof  we  have  to  show  that  if  £ < A < tj,  then  (3.3) 
does  not  hold  for  some  A e C „ . First  assume  0 < A < ti.  That  is, 
for  some  •£,  1 < # < n, 

(3-13)  + • • • + y'£)  < J (72  + • • ■ + 7£) dM-(c)  . 

Consider  the  matrix  A^  = 1^  © 0^  A simple  computation  shows  that 

for  an  ordered  vector  c,  the  range  W (A,)  is  a real  interval  with 
right  end-point  7^  + ' ' ' + 7^-  Then,  the  left  side  of  (3.3)  represents 
a real  interval  with  right  end-point 

J (71  + •••  + 7i)dp-(c)  , 

which,  by  (3.I3),  exceeds  the  right  end-point  A(7^  + •••  + y\)  of  W,  , . 

Finally,  if  £(c')  < A < 0,  then  (3. 11)  implies  that  0 < -A  < r|(c") 
where  c"  = (-7^, • • • , -7^) . Thus  by  the  above  example  the  inclusion 

J Wc(A^)d4(c)  c -AWc„(A£)  = AWc,(Ap 

A 

fails  to  hold,  and  the  theorem  follows . 

We  remember  of  course,  that  we  restricted  integration  to  the  domain 
A for  convenience  only.  Therefore,  if  so  desired,  M-(c)  can  be 


1 
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extended  to  the  domain  (l,  and  Theorem  3 remains  valid. 

If  is  concentrated  at  a finite  number  of  vectors  c., '"jO  6 r’ 

then  Theorem  3 characterizes  all  A for  which 
m 

E p(c.)W  (A)  c AW  ,(A)  , VA  e C . 
i=l  1 ci  c nAri 

A result  of  this  type  is  given  in  Theorem  1 of  [2] . 

Of  particular  interest  is  the  case  where  |i  is  concentrated  at  a 

single  vector  c"  € 0.  That  is, 


and  t), £ of  (3. 13)  are  given  now  by 


T](c 1 ) = max 


It 

71  + 


+ 7 , 


l<i<n  7i  + 


+ 7 


7 5 5(c')  = 


mm 


'I* 


+ 7 


l<i<n  7i  + 


+ 7 


Thus,  from  Theorem  3 we  conclude, 


COROLLARY.  Let  c'  ^0  and  c"  be  ordered  vectors  with  T;  7'.  = 7)  7"  = 0. 

J J 

Then 

W (A)  c AW  , (A)  , VA  € c v 
c"  c nxn 

if  and  only  if  A > T)(c  ' ) or  A < £(c  * ) where  rj,  £ are  given  in  ( 3 -1^+)  . 

This  result  was  proved  differently  in  Theorem  8 of  [3]- 


J 


w 
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19  KEY  WORDS  (Continue  on  reverae  aide  it  neceaaery  end  identity  by  block  number) 

Generalized  numerical  ranges 
Convex  sets 

Integrals  of  numerical  ranges 


20.  ABSTRACT  (Continue  on  reverae  aide  It  neceaaery  and  identify  by  block  number) 

Let  c = (7^,r.*,7  ) be  given.  The  generalized  numerical  range  of  an 

n X n matrix  A,  associated  with  c,  is  the  set  W (A)  = {£  7.(Ax.,x.)] 

c n 0 J J 

where  (x^,...,xq)  varies  over  orthonormal  systems  in  C • Characterizations 
of  this  range,  for  real  c,  are  given.  Next,  we  study  integrals  of  the  form 
I Wc(A)dh(c)  where  h(c)  is  a measure  defined  on  a domain  in  I?n.  The 
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inclusion  bolls  for  all  n X n matrices  A.  Such  relations  lead  to 


more  elementary  ones,  when  the  integral  reduces  to  a finite  linear 
combination  of  ranges.  In  particular,  -we  obtain  the  inclusion  relations 
of  the  form  W (A)  c A.W  ,(A)  which  hold  for  all  A. 
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